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ABSTRACT 


A comparison was made among the CEAS crop I’eportlng district (CRD), 
agrophysical unit (APU), and state level yield mcxiels for com and soybeans 
In lovra and barley and spring wheat In North Dakota. The best predictions 
were made by the state moiel for North Dakota spring wheat, by the APU models 
for North Dakota barley, by the CRD models for Iowa soybearis, and by APU 
covariance models for Iowa com. Because of this lack of consistency of model 
performance, CRD models would be recommended due to the availability of the 
data. 

Acknowledgements 

The author would like to thank Clarence Sakaxnoto, Sharon LeDuc, Wendell 
Wilson, Jeanne Sebaugh and Tom Barnett of the AgRISTARS Yield Model Development 
Project for their ccmments, Rita Terry for her editing, and Sue Monteer for her 
typing. 



ORIGINAL PAQS IS 
OF POOR QUALITY 


Conparlswi of AHJ, anti State Yield Models for 
Com and Soybeans In Io»« and Barley 
and Spring Wheat In North Hakota 


by 

Vlkkl KVench 


"Tils research vms conducte^i as part of the Ap^^TSTARS Yield Model hevelopment 
Project. Tt Is part of "^sk 4 (subtask In rwjor project elanent 1, as 
Identified Ir the Yield Model hevelonnent Tmplenentatlon Plan. As an 
Internal project iloeunent, this renort Is Identified as showi belcm: 

.AgRI.‘?TARR 

Yield Model Developnmt Project 


YMp-l-ll-? (RR-001) 


May, 1983 



ORICSi-AL RAOE \S 
OF POOR 0^'Ai !TY 


Table of Contents 

Page 

Review of Models 1 

Fvaluatlon Methodology 1 

Comparison Methodology 2 

Model Comparison 3 

Recommendations ^ 

References 5 

Appendix ^ 



OF POOR 


qUmUTY 


List of Tables 


Page 


Table 1: Indicators of Yield Reliability for Model Comparison - 

North Dakota Spring Wheat 6 

Table 2 : Indicators of Yield Reliability for Model Comparison - 

North Dakota Barley 6 

Table 3; Indicators of Yield Reliability for Model Comparison - 

Iowa Soybeans 7 


Table Indicators of Yield Reliability for Model Comparison - 
Iowa Com 


7 



OF POOR QUi-.»-i.Y 


Comparison of CPD, APH, and State Yield f^bdels for Com 
and Soybeans In Iowa and Parley and Spring V/heat In North Dakota 

by vikkl French 


pe\t:w op mddels 

The CFAS models are multiple regression models vhlch predict crop yields 
using meteorological variables based on monthly mean temperature and monthly 
total precipitation, '^rend terns are simulated by piecewise linear and 
qioadratlc functions of year. Ntodels for North Dakota spring wheat and barley 
and Iowa com and soybeans have been developed. Some models were developed 
for crop reporting districts (CRDs). others were developed for agrophvslcal 
units CAPUs), and still others were developed for the entire state. It Is 
the intent of this study to compare CPD, APH, and state models to determine 
which models lead to the most accurate prediction of crop .'/ields. 

Parley models for ^’orth Dakota CRDs and for the state were developed by 
Raymond Motha (ICROa). Spring vfrieat CPD and state models were developed by 
Sharr)n LeDiic (Idf^l), as were the barley and spring wheat APU models (LeDuc 
19^^2a). Raymond Motha (IdPOb) developed the soybean models for Iowa CRDs and 
state and Sharon LeDiic (IPRO) the com CRD and state models for Iowa. The 
APT! com and soybean models for Iowa wer^ developed by Sharon LeDuc (19^2b). 

FVALUA'T'IOM MFTWODOLnaY 

County level meteorological data were averaged to produce both CPD arxi APR 
level data. County level production and harvested area data were summed to 
the CPP and APR level and the yield calculated. Meteorologlcsd data weire 
weighted by harvested area and aggregated to the state level for the state 
model. Pootstrap tests were for the years 1^70 to 1^70 for barley, spring 
wheat, and soybeans, and 1071 to ICPC for corn. CPD and stfite models for each 
crop used the variables i.>(hich had been previously determined. A separate APU 
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node! fop each APU was used (APUl), A second APU tnalel usel a covariance 
methodology which required all coefficients to remain the same across the state 
so that mly the intercepts could vary between APUs (APU2). This second 
methodology was documentetl for the APU com and soybeans but not for barley 
or spring wheat. These latter trKxiels were ileveloped specifically for this 
comparison by the model developer (.Sharon LeDuc>. 

fDMPARISON MPThOnOLOGY 

Comparison was made on the basis of the difference between observei! yields 
anil the various moilel pre^iictlons for the ten bootstrap test years. The same 
base period was used for all models In ccmputlng model-relatel values for a 
particular year. 

Separate yield pre^llctions were made for each CRD and AFU (using the APUl 
;and APU2 mcnlels^. A welghteil average of the CPP, APUl or APUS pre^llctlons 
was use\1 to pro<1uce state level pre^lictlons. "!he weighting factor usevi was 
harveste<1 hectares. These aggregate^! predictions (CRD, APUl, and APU2) could 
be comppretl to the state moilel prediction (Rtate'> . 

The models were compare^i on the basis of each of the following Indicators 
(if yield reliability (Wilson et ;al., IQPO''. Order does not imply relative 
Importance. 

( 1 1 the bias , 

(?'' the root mean snuare error (RMSE'i, 
the standani deviation (RD\ 

(ii’' the percent of years the absolute value of the relative difference 
exceeds ten percent (!• RD'', 

the largest absolute value of the relative difference (| REj ^direction Is 
Indicated' , 

the next largest absolute value of the relative (ilfference (( REj 2' (direction 
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la Indicated), 

(7) the percent of yeara In which the direction of chemge from the previous 
year In the Y’s (estimated yields) agrees with the Y's (observed yields) 
(DC), 

(R) the percent of years In which the direction of change from the average 
of the previous three years In the Y's agrees with the Y's (DC3), and 
(9) the Pearson correlation coefficient between the actual and predicted 
yields during the Independent test years (Corr). 

For the Indicators (1) - (6), the model with the smallest numeric value 
Is the best In terns of yield reliability, the remaining quantities, the 

model with the largest value Is best. 

Tt should be remembered that the models were compared only in relation to 
one another and not to an absolute standard. 'Tierefore, saying that a 
particular model was best does not necessarily imply that the rrxlel would be 
the best of all possible models. It wotxld be the best lonly of those with 
which It was compared. 

’^caiise the PKxiels were develope«1 by different people, differences be- 
tween the models would not necessarily be due to differences In the stratifi- 
cation. Any comparison between models would also be a comparison of model 
development techniques. Tt wotild be difficult to separate which part of the 
difference was due to stratification and which to moiielers. For the purposes 
of this paper. It was assumed that any differences detecteil would be due to 
stratification only. 


’-inDFl COMPARISON 

lYie Indicators of yield reliability based on the difference between 
observe»1 yields and predicted yields are shown In Tables 1, 2, 3 and The 

observed yields, nredlctel yields, and differences are In the Appendix. No 
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node! Is clearly better than the others In all cases. 

The state mo«1el Is clearly preferable for sprlr« wheat In North Dakota. Tt 
Is the best nrxiel for sorlrw wheat accordlnK to all of the Indicators except 
for the two direction of charwe Indicators, DC and DC3. Por these two Indicators, 
the APJ covariance nodels, APU2, would be preferred. 

For barley, no node! 1s obviously preferable. The state nodel would be 
preferretl using the Indicators standard deviation (SD), correlation (Corr), and 
I Rli . The CRD models would be preferreil using the Indicators bias, tRD, and 
DC3. 'Die APni moilels would he preferable for the Indicators root mean square 
error ^rd, and | Rrj 2. 'Die state no»1el would be the least preferable In 

terns of bias, RMSE, anil 5RD, the CRD moilels In terns of DC3, and the APU2 
moiiels In terns of | Rlj 2. The APJl models would probably he the best taking 
all of these Into consideration. 

The I'RD noilels are generally better for Iowa soybeans as Indicated by all 
hut two of the Indicators, bias and | pr| 2. The state no<1el fares poorly, the 
worst on all Indicators except bias, SD, am1 | REj . 

’^or Iowa com, the APU covariance models, APN2, would be reccpnendeti on the 
basis of RFSE, SD, | RE| , | RTI 2, DC3, am1 Corr. Again, the state model Is poor, 
having the worst Indicators on all except bias. 

RECOMMEMDATTONP 

In simary, the state rrvlels would be better for North Dakota spring viheat 
and the APU moilels for North Dakota barley. The CRD mmlels would be preferreil 
for Iowa soybeans and the APJ2 moiels for Iowa com. This remarkable Im- 
partiality Is not very encotiraglng for researchers who would like to be able 
to recomend one methodology which would be consistently better. CRD and state 
data are more readily available than AP’ data, ^cause of this, with no 
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evidence that APU models are consistently better, CRD or state models would be 

recomended. The state monel, however, was not satisfactory for Iowa com. 

Indicating that the CRD models should be the first choice. 
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T^ble 1 

Indlcatops of Yield Reliability for Model 
Conparlson-North Dakota Spring Wheat 



State 

CRD 

APUl 

APU2 

Bias 

-0.15 

0.58 

0.86 

0.52 

RMSF, 

l.i<5 


2.62 

l.RU 

SD 

l.ti^ 

1.53 

2.1*7 

1.77 

%BD 

20 

30 

70 

30 

iRTl 

IQ.n 

25.3 

27.2 

29.7 

|RE|? 

13.1 

15.1 

25.8 

-13.5 

DC 

7ft 

7ft 

67 

89 

DC3 

5T 

57 

57 

86 

Corr 

n.?3 

0.72 

0.63 

0.66 


Tlable 2 

Indicators of Yield Reliability for Model 
Conparison-Morth Dakota Parley 



State 

CRD 

APUl 

APU2 

Bias 

-1.90 

0.14 

0.36 

-0.23 

RMSE 

2.29 

2.1ft 

1.44 

1.57 

SD 

1.27 

2.18 

1.40 

1.55 

^RD 

60 

20 

20 

30 

1 RT| 

-13.2 

3'4.4 

19.2 

15.9 

1 RH 2 

-12.7 

11.5 

10.4 

13.1 

DC 

67 

67 

67 

67 

DC3 

R6 

71 

86 

86 

Corr 

n.Qi4 

0.6R 

0.fl9 

0.A4 
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TaDle 3 

Indicators of Yield Reliability for Model 
Conparlson-Iowa Soybeans 



State 

CRD 

APUl 

Bias 

0.13 

0.U9 

0.37 

RT^F 

1.7R 

l.OQ 

1.26 

SD 

1.7S 

0.9« 

1.20 

^RT 

20 

10 

10 

|or| ■ 

-?7.2 

16.0 

20.2 

1 Rii ? 

10.0 

4.1 

-3.7 

DC 

S6 

7R 

67 

DC3 

71 

100 

R6 

Corr 

0.71 

0.R6 

0.7fl 




Table 4 



Indicators of Yield Rellabllty f 



Comparlson-Iovia Com 


State 

CRD 

APUl 

Bias 

0.6U 

0.77 

2.64 

RMSE 

R.35 

7.39 

6.52 

SD 

R.33 

7.35 

5.97 

?PD 

12. R 

11.3 

R.9 

1 RTl 

UO 

40 

40 

1 Wl 2 

-22.0 

14.9 

12.2 

DC 

SO 

50 

40 

DC3 

7*) 

75 

RR 

Corn 

0.56 

0.61 

0.75 


APU2 

O.UO 

l.lR 

1.11 

10 

lS.il 

6.3 

7ft 

ftfi 

O.Rl 


APU2 

1.99 

6.M7 

6.16 

9.3 

30 

- 11.0 

i|0 

Rfl 

0.7S 
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Observed and Predicted Yields 
for Bootstrap 7est Years 
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OBSERVED ANO PREDICTED YIELDS 
north DAKOTA SPRING WHEAT - CRD 



year I observed I 

PREDICTED 1 

0 

1 RO 

YIELD 

>^IElU 




IR70 

15,8 

19,0 

1971 

21. H 

21.5 

1972 

19.4 

21.5 

IR7J 

18.5 

18.1 


13.7 

15.9 

1R75 

17.4 

17.1 

197E 

16.6 

16.7 

1 R77 

16.7 

10.2 

1978 

20.1 

19.4 

1 9 79 

1 7.7 

l0.9 



OBSERVED and PREDICTED TIELDS 
Nv.Uh DAKOTA spring WHEAT - APU 
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OBSERVED and PREDICTED YIELDS 
north DAKOTA SPRING WHEAT - STATE 


YEAR 

iobservedi predicted 
yield yield 

1 0 

1 OU 


15.3 

16.3 




21. A 

21.5 



1972 

19.4 

19.1 



1973 

18.5 

17.0 



197^ 

13.7 

15.5 



1975 

17.4 

16.7 



1976 

16.6 

16.7 

0.1 

0.6 

197/ 

16.7 

15.3 

-1.4 

-8.4 

197S 

20.1 

18.1 

-2.0 

-10.0 

1979 

17.7 

17.1 

-0.6 

-3.4 

OBSERVED and predicted YIELDS 

north Dakota spring wheat 

- APU COV 

YEAR 1 OBSERVED! 
YIELD 

PREDICTED 1 
YIELD 

0 1 

RD 

1970 

IS. 8 

• 20.5 

|B| 

29.7 

1971 

21.4 

21.2 

in 

-0.9 


19.4 

21.1 


8.8 


lb. 5 

16.0 

n 

-13.5 

i97** 

13.7 

15.1 

1.. 

10.2 

1975 

17.4 

17.7 

mgM 


1976 

16.6 

17.2 

■B 


1977 

16.7 

16.2 

-0.5 


197b 

20.1 

20.0 

-0.1 


1979 

17.7 

17.5 

m 

-1.1 
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OBSERVED AND PREDICTED YIELDS 
IOWA SOYBEANS - CRD 


YEAR 

iobsepvedi predicted 
YIELD yield 

0 

PD 


21.9 

21.9 


0.0 


21.9 

22. B 


4.1 


24.2 

23.6 

HM 

-2.5 


22.9 

23.2 

■B 

1.3 

197A 

18.8 

21.8 

3.0 


1975 

22.9 

23.2 

0.3 


1976 

20.0 

21.2 

0 


1977 

23.9 

23.3 

-0.6 


1978 

25.2 

26.2 

1.0 

4.0 

1979 

25.2 

25.4 

0.2 

0.8 


OBSERVED and PREDICTED YIELDS 
IOWA SOYBEANS - APU 


YEAR 

iobservedi predicted 

YIELD yield 

1 D 

RD 


21.9 

22.0 

0.1 

0.5 


21.9 

21.7 

-0.2 

-0.9 


24.2 

23.3 

-0.9 

-3.7 


22.9 

23.4 

0.5 

2.2 

1974 

18.8 

22.6 

3.8 

20.2 

1975 

22.9 

23.0 

0.1 

0.4 

1976 

20.8 

21.1 

0.3 

1.4 

1977 

23.9 

23.8' 

-0.1 


1978 

25.2 

25.0 

-0.2 


1979 

25.2 

25.5 

1 

0.3 

1 
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OBSERVED AND PREDICTED YIELDS 
IOWA SOYBEANS - state 


YEAR 

1 observed 1 predicted 
YIELD YIELD 

0 

RO 


21.9 

21.2 

-0.7 



21.9 

24.1 

2.2 



24.2 

24.5 

0.3 



22.9 

24.6 

1.7 


1974 

18.6 

19.9 

1.1 


1975 

22.9 

22.6 

mgM 

-1.3 

1976 

20.8 

19.8 


-4.8 

197/ 

23.9 

19.8 


-17.2 

197tt 

25.2 

27.0 


7.1 

1979 

25.2 

25.5 

B 

1.2 


OBSERVED and PREDICTED YIELDS 
IOWA SOYBEANS - APU COV 


YEAR 

•OBSERVED 

YIELD 

PREDICTED 

YIELD 

0 

RD 


21.9 

22.0 


0.5 


21.9 

22.6 


3.2 


24.2 

23.5 

-0.7 

-2.9 


22.9 

22.5 

- 0.4 

-1.7 

1974 

18.8 

21.7 

2.9 

15.4 

1975 

22.9 

23.0 

0.1 


1976 

20.8 

21.3 

0.5 


1977 

23.9 

22.7 

- 1.2 


1978 

25.2 

26.6 

1.6 


1979 

25.2 

25.6 

0.4 

1.6 
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rtAri lOBStRVEOI 

P9E0J 

[CTEO 1 

D 

1 RO 

YIELO 

vn 

■LO 




\'i^^ 

197J 

l'i7- 

ly7^ 
W7 7 
l‘J7H 
ls>rv 

IQSO 




Ol'S£*<vEt) AmO ^’«£l'>U'U 0 
low A CORN - APli 



YEAR IOBSERVEDI 

preoj 

[CTED 1 

D 

1 l»0 

YIELO 

Ylf 

-LO 




IR71 

I'iJd 

W7J 

l‘i7*« 

ls»7b 

ls>77 

1R73 

\^7') 
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OBSERVED AND PREDICTED YIELDS 
IOWA CORN - STATE 



YEAR 1 observed 1 

PREDJ 

[CTED 1 

D 

1 RD 

YIELD 

YI( 

•LD 





197<» 

197b 

197b 

1977 

1978 

1979 


64.0 

66.3 

72.6 

65.2 

67.2 

69.6 

50.2 

68 • 8 

56.5 

59.3 

57.1 

64.4 

5‘*.0 

42.1 

72.2 

75.5 

79.7 

72.0 

69.0 

65.9 



OBSERVED AND PREDICTED YIELDS 
IOWA CORN - APU COV 



1971 

197 ^ 


1975 

1976 

1977 

1978 

1979 


64.0 
72.8 

67.2 

50.2 
56.5 

57.1 

54.0 

72.2 
79.7 

69.0 


66.0 

64.1 

62.1 

62.4 

56.7 

73.5 

71.7 



YEAR 1 observed 1 

predicted I 

D 

1 RD 

YIELD 

yield 
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OBSERVED AND PREDICTED YIELDS 
NORTH Dakota barley - crd 


YEAR 1 

iobservedi predicted 
YIELD yield 

1 D 

1 RO 

1970 

18.3 

20.^ 

Bl 

11.5 

1971 

24.2 

23.4 


-3.3 

1972 

21.5 

22.6 


5. 1 

1973 

19.9 

GO 

• 

O 

CVJ 

0.9 

4.5 

197^ 

15.1 

20.3 

5.2 

34.4 

1975 


19.1 

-1.3 

-6.4 

1976 


19.6 

-0.8 

-3.9 

1977 


20.7 

-0.3 

-1.4 

1978 


22.4 

-2.3 

-9.3 

1979 


22.3 

-2.4 

-9.7 


OBSERVED and PREDICTED YIElOS 
north Dakota baklEv - apu 


YEAR 

iobsepvedi predicted 

YIELD yield 

1 D 

1 RD 


18.3 

20.2 


■Hill 


24.2 

23.7 


Bl 


21 .5 

21.0 


1.4 


19.9 

19.5 

-0.4 

-2.0 

1974 

15.1 

18.0 


19.2 

1975 


21.9 


7.4 

1976 

20.4 

21 .5 

1.1 

5.4 

1977 

21.0 

19.0 

-2.0 

-9.5 

1978 

24.7 

23.9 

-0.8 

-3.2 

1979 

24.7 

24.3 

- 0.4 

-1.6 


IS 
















ORIGINAL PAGE IS 
OF POOR QUALITY 


OBSERVED ANO PREDICTED YIELDS 
north Dakota barley - state 


YEAR 1 OBSERVED 1 
YIELD 

predicted 

YIELD 

D 

RD 


18.3 

16.9 

-l.A 


IQI 

2^.2 

21.0 

-3.2 



21.5 

19.8 

-1.7 



19.9 

17.9 




15.1 

16.2 

M 

7.3 

197S 

• 

O 

fVJ 

17.8 

-2.6 

-12.7 

1976 

20. A 

19.8 

-0.6 

-2.9 

1977 

21.0 

18.5 

-2.5 

-11.9 

1978 

2A.7 

21.7 

-3.0 

-12.1 

1979 

2A.7 

21.6 

-3.1 

-12.6 


OBSERVED AND PREDICTED YIELDS 
NORTH DAKOTA BARLEY - APU COV 


YEAR 

[OBSERVED 

YIELD 

PREDICTED 

YIELD 

D 

RD 

1970 

18.3 

20.7 


13.1 

1971 

rvj 

• 

CM 

23.6 


-2.5 

1972 

21.5 

• 

O 

CM 


-5.1 

1973 

19.9 

18.3 


-8.0 

197A 

15.1 

17.5 


15.9 

1975 

20.4 

21.2 

0.8 

3.9 

1976 

• 

o 

(VI 

19.7 


-3.4 

1977 

21.0 

18.8 



1978 

24.7 

23.0 

-1.7 


1979 

• 

CM 

24.7 

B 
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